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SUMMARY 


A method is presented for describing the statistical characteristics of 
the spontaneous electrical activity of nerve units that have stochastic dead 
times following an impulse. The method is based on the determination of the 
possible functional forms of the marginal cumulative distribution of the inter 
spike times that result from a concept of the nerve unit behavior suggested by 
the work of Harris and Flock. For the purpose of illustration, the method is 
applied in the appendix to an observed series of electrical impulses originat- 
ing spontaneously from an isolated vestibular nerve unit of the frog . 


INTRODUCTION 


This paper presents a method of empirically modeling the statistical 
structure of a time-dependent series of electrical impulses spontaneously 
emitted by nerve units that have a stochastic dead time following each impulse 
Examples of such nerve units are the Xenopus laevis lateral line units studied 
by Harris and Flock (ref. 1), who showed that a pronounced dead time or refrac 
tory period following the occurrence of an electrical impulse is characteris- 
tic of the observed interspike times . The approach is developed within the 
framework of a stationary stochastic point process and is based on the pos- 
sible functional representations of the marginal distribution function which 
defines the probability that an interspike time is less than or equal to a 
given length of time. 

Moore , Perkel , and Segundo (ref. 2) pointed out that neuronal spike 
trains (series of electrical impulses) may be analyzed within the context of 
stochastic point processes . Characteristically, these processes are time 
dependent and the events of interest are discrete, for example, particle 
emissions of a radioactive source where the observed event is a particle 
emission at some point in time (ref. 3). One common method of representing 
the characteristics of such a series of impulses is to define the ordered 
sequence of interval times x^ , t 2 , x 3 , . . . , where x^ denotes the interval 
between the (i - l)st and ith impulse. A typical interval time process 
associated with a given series of impulses is shown in figure 1. In the 
particular case of electrical neuronal activity, the observed event would be 
the electrical impulse or action potential measured at a point in time. 
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Figure 1.- Series of events and its associated interval time process. 

The variation indicates the time between the (i-l)st and 

the ith event where the hash marks indicate the events. 

In a neuronal unit a pronounced dead time following an impulse will most 
certainly be reflected in the interspike (interval time) process. Hence, any 
method used to describe the activity of nerve units that exhibit a dead time 
should take this characteristic into account. Therefore the approach used in 
this paper includes a stochastic dead time in the conceptualization of a given 
interspike time which in turn provides a means of examining how such a dead 
time can affect the marginal distribution function of the interspike times. 
This function determines many of the statistical characteristics of the inter- 
val time process exhibited by neuronal units, such as discussed above, and 
under certain conditions it completely defines the process. Moreover, the 
method presented here utilizes the explicit forms of the marginal distribution 
function that result from the conceptualization of a given interval time as 
possible empirical models that may be useful in characterizing the spontaneous 
electrical activity of neuronal units heretofore discussed. 

The factors considered in the conceptualization are discussed, and for 
illustrative purposes, the method developed here is applied in the appendix 
to the observed spontaneous activity of an isolated vestibular nerve unit of 
the frog. 


APPROACH 


Factors Considered in the Conceptualization 
of the Interspike Time 

In order to simplify the problem of statistically describing the spon- 
taneous electrical activity of neuronal units that exhibit a dead time, the 
general factors considered here are essentially those suggested by the work of 
Harris and Flock. The problem can then be idealized in the following manner. 

The unit is considered to be comprised of several interacting sensory 
cells, and the observed spike (action potential) is regarded as originating 
from one of the cells. Harris and Flock regarded the unit as capable of gen- 
erating a spike by spontaneous depolarization of a cell membrane defined here 
as event 1 , or by the random excitation of the sensory receptors of the cell 
defined as event 2. Although they concluded that spontaneous depolarization 
is the more likely, both hypotheses are considered here for the purpose of 
developing methods of characterizing the general situation. 
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Moreover, if an observed spike is due to the spontaneous membrane 
depolarization (event 1), the unit enters a prolonged dead period resulting 
from some form of inhibitory interaction and is defined to be in condition 1. 
If, however, the spike results from the random excitation of the sensory 
receptors of the cell (event 2), the unit enters a dead period whose duration 
is a function of the refractory period of the nerve fiber, and the unit is 
then defined to be in condition 2. 

The possible unit conditions following the Mth and (M+l)st spike and 
the associated events that must be accounted for in the statistical character- 
ization of the interval time process are shown in figure 2. 










TIME 

** i 

"5 

r ik i 


Figure 2.- Possible unit conditions following the Mth and (M+l)st spike. 
The variable x., denotes the inter-spike time if the Mth spike is 
due to event k 1 where i and k = 1 or 2, while r^ denotes the dead 
time if the unit following the Mth spike is in condition i where 
i = 1 or 2. 


In this figure a given interval of time is defined by one of four pos- 
sible intervals denoted by the variables in, x 12 , x 21 , and x 22 . A given 
interval , say xj 2 , is defined by two adj acent spikes, denoted by subscripts, 
in this case 12. The first subscript denotes that the first spike is due to 
spontaneous depolarization and the second indicates that the second spike is 
’ due to the random excitation. Thus the original interval time 
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process, denoted by the ordered sequence of interval times x ls x 2 ,X 3, . . . , 
may be redefined in terms of the four possible interval types. For example, 
the interval time process may be given by th,x 21 ,x 12 ,x 22 , • • •• Consecutive 
intervals are restricted because only interval type x 12 or 1:3 3 can follow xn 
or t 2 j, while only x 2 i or x 22 can follow t 2 2 or x 12 , Also, the interval 
types denoted by xn and x 12 contain the dead time associated with the spon- 
taneous depolarization hypothesis, whereas x 2 j and x 22 exhibit the dead time 
associated with the random excitation hypothesis. 

Thus, it is evident that the marginal distribution function of the inter- 
val times, a function of particular use in describing the statistical charac- 
teristics of the interval time process, and defined as F (t) = Prob (x <_ t) 
where x denotes a given interval time or, equivalently, the probability 
density function f (t) = dF T (t)/dt is dependent on the statistical character- 
istics of the four possible types of interval times and the manner in which 
they are related in the interval time process. It should be noted that 
although conceptualizations such as used here are generally not unique, they 
are important as an economical means of studying the possible forms of the 
various statistical functions that may have use in empirically modeling the 
observed behavior of the process under investigation. To this end, the mar- 
ginal distribution function (henceforth referred to as the distribution func- 
tion) that results from the characterization of the interval time process shown 
in figure 2 is outlined in the following section. 


Derivation of Distribution Function and Statistical Description 

of the Interspike Times 

In general, the statistical characteristics of any stochastic point 
process cannot be adequately described by simple functions, such as the dis- 
tribution function, unless the process is stationary; that is, the joint dis- 
tribution of the number of events in k fixed time intervals is invariant 
under time translations. This implies that the number of events occurring in a 
period of time is proportional to the time length of the period, and, moreover, 
that the distribution of the interval times is identical for all the interval 
times contained in the process if the origin is defined by an arbitrarily 
chosen spike. For these reasons stationarity will be assumed and the origin 
of the interval time process is taken to be an arbitrary spike. Within this 
framework, the distribution function (F x (t) , or, equivalently, the probability 
density function f x (t), of the interval time process may be derived as 
follows. 

The following variables describe the statistical characteristics of the 
Mth interval time (interval time between the (M-l)st and Mth spike). If it is 
assumed that the (M-l)st spike is due to event 1 (spontaneous depolarization) 
and, hence, the unit is in condition 1 (dead time associated spontaneous 
depolarization) , then 

x , the time length of the Mth interval if the Mth spike is due to 
event k where k = 1,2 
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rj the dead period following the (M-l)st spike 

s k T ik " r ! » t ^ ie waiting time, measured from the end of the dead period, 
to the Mth spike which may be due to event fc; k = 1 or 2 

Similarly, assume that the (M-l)st spike is due to event 2 (random excitation) 
and the unit is now in condition 2 (dead time associated with random excita- 
tion) , and define 

t , the time length of the Mth interval if the Mth spike is due to 
event k where k = 1,2 

r 2 the dead period following the (M-l)st spike 

s k T 2 k “ r 2 » the waiting time, measured from the end of the dead period, 

to the Mth spike which is due to event k t k = 1 or 2 

Further, define the conditional transition probabilities associated with the 
two possible events (1 or 2) and the resulting four types of possible interval 
times in, T 1 2 > x 2l> t 22 by 

$11 probability that the Mth spike is due to event 1 given that the 

(M-l)st spike was due to event 1 (The associated interval time is 
denoted by tn.) 

$12 (1 - 6 i i ) probability that the Mth spike is due to event 2 given that 

the (M-l)st spike was due to event 1 (The corresponding interval time 
is given by ti 2 .) 

g 2 i probability that the Mth spike is due to event 1 given that the 

(M-l)st spike was due to event 2 (The corresponding interval time is 
given by T 2i .) 

6 22 (1 - e 2i ) probability that the Mth spike is due to event 2 given that 

the (M-l)st spike was due to event 2 (The corresponding interval 
time is given by x 22 .) 

The probability density function of the interval times may now be derived in 
terms of the transition probabilities Bn, $ 12 , £21 > £22 and the probability 
density functions f Xll (t), f Tl2 (t), f t21 (t), f-r 22 (t) of each interval type from 
the possible relationships of interval types between the (M-l)st interval and 
the Mth interval as schematically shown in figure 3. 
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Mth interval 



Transition probability of B 21 



-►*21 


Transition probability of g 


22 


"► x 22 


Figure 3.- Possible interval types at adjacent intervals. 
Quantities denote the transition probability tha 

the second interval will be of a specified type. 


If 

Pi 

P2 

P3 

P 4 


probability that the next interval to occur in the interval time process 
is defined by the variable in 

probability that the next interval to occur is defined by ti 2 
probability that the next interval to occur is defined by t 21 
probability that the next interval to occur is defined by t 22 


6 


A-3818 



where p 1 + p 2 + p 3 + p 1+ = 1, the probability density function of the interval 
time process is 


f T (t) =p 1 f Tn (t) +p 2 f Tl2 (t) +p 3 f T2 i(t) +p 4 f T22 (t)» t >.min(T 11 ,T 1 2,T2i,T 2 2) 


(la) 


or, equivalently, the distribution function is 


F t00 = f Pi f TU (t) dt + f p 2 f Ti2(t) d t + f 

* / min(T 1 i) 4 'min(t 12 ) min(T 2 i) 


^3^X21 


+ f . P4 f T 2 2^ t ^ dt 

a 'min(T 2 2) 


(lb) 


The probabilities p 1 , p 2 , p 3 , and p 4 can be expressed in terms of the transi- 
tion probabilities B 13 , g 12 , B 2 j> and g 22 , using the relations shown in fig- 
ure 3, as follows: 


Pi = e n p l + 811P3 

p 2 = £ 12 p 3 + B 12 P 1 

P 3 = e 2lP 2 + 6 2lP4 

P 4 = 6 22 P4 + e 22 P4 


These relationships show that 

Pj = (1 - B 22 )g 11 /(2 - Bn - B 22 ) 

p 2 = (1 - 3n)(l - 6 22 ) / (2 - 3i 1 - B 22 ) 

P 3 = P 2 

p 4 = (1 - Bn)B 22 /(2 - Bn - B 22 ) 

Thus, the density function, given by equation (la), can be expressed in 
terms of the transition probabilities as 
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f.00 = a - B 22 )/(2 - Bn - + ^ ~ Pn) £ T 12 Ct)] 

+ (1 - 811D/ (2 - Bn - B22) t C 1 " B 22 ) £ t 21 + 622^X22^^ » 

t >_ min (Jn ,T i 2 » T 2 i ,T 22 l ( lc ) 

Equation (1c) can be somewhat simplified if the probability density function of 
the random variable X 1 is defined as 

gl (t) = B u f Tn (t) + (l - B n )f Tl2 (t), X x l min (T nJ T 12 ) 
and the probability density function of the random variable X 2 as 

g 2 (t) = (1 - B 22 )f T21 (t) + B 22 f T22 (t), X 2 l min (t 21> t 22 ) 

Letting 


01 = (1 - B 22 )/ (2 - Bj j - B22I 

we can write the density function of the interval time t as 

f T (t) = ct g 1 (t) + (1 - ot)g 2 (t), t >. min (X^X^ 


which is seen to be the form of the density function derived from a two-state 
semi-Markov process model (ref, 4) . 

The average interval time length* the variance* and the serial correla- 
tion function are descriptive characteristics of the process that can be 
derived immediately from the probability density function as given by equa- 
tion (la) or (lc) , The average interval time length of the process is given 
by 

E (t) = aE(X x ) + (1 - a)E(X 2 ) (Id) 

and. the variance by 

Var(x) = aVar(Xx) + (1 - a)Var(X 2 ) + ot(l - aHE^) - E(X 2 )] 2 (le) 

where 


E(Xi) = B 1 1 J tf Tn (t)dt + (1 - 

o/ min(x n ) 


611) 


tf. 


min(x 12 ) 


•12 


(t)dt 
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r °o 

E(X 2 ) = (1 - $ 22 ) / . 

*Mnin(x 21 ) 


tf T (t)dt + $22 


f «, 

*'min(T 2 2) 22 


(t)dt 


Var (X x ) 


Var (X 2 ) 


3ii f [t - E(Xj)]2f (t)dt(l - $n) 

*'min(T 11 ) 11 

/ oo 

[t - E(X!)]2f (t)dt 
min(T 12 ) 12 


(1 - $22) 


s 

^min(x 21 ) 


[t - E(X 2 )] 2 f T (t)dt 


21 


$22 i[^ “ E(X 2 ) ] 2 fx 2 2 (^)dt 

•/min(x 2 2 ) 


Finally, the serial correlation function of lag k, which measures the linear 
dependence between every kth interval time contained in the process, is shown 
by Cox and Lewis (ref. 4) to be 


[E(Xi) - E(X 2 )] 2 oi( 1 - a) (0ii + $22 - l) k 

p = (If) 

aVar(Xx) + (1 - a)Var(X 2 ) + a(l - a)[E(Xi) - E(X 2 )] 

It is seen that equation (la) or (lc) expresses the probability density 
of the interval time in terms of the density functions of the four intervals 
T H> t 12» t 21 > t 22» while equation (lb) establishes the same type of relation- 
ship for the distribution function. Also, equations (Id), (le), and (If) show 
how the descriptive characteristics as given by the mean, variance, and serial 
correlation function, depend on the characteristics of the four interval types. 
Hence, these relationships provide a basis for examining how the characteristics 
of the four interval types are reflected in a given interval of time. In order 
to obtain explicit functional forms that define the statistical characteristics 
of a given interval of time for these equations, plausible forms of the dis- 
tribution functions of xu, xi 2 > T 21> and x 22 or, equivalently, r ls r 2 , s* , 
and s 2 must be postulated. Since the spontaneous electrical activity exhi- 
bited by neuronal units is generally considered to be a random and steady-state 
type phenomenon, it seems reasonable to assume the null-type hypothesis that 
the variables r^, s*, and S 2 are random and are defined by events that occur 
according to the Poisson criterion of randomness (ref. 5) or approximately so. 

In such case, the density functions of these variables are expressed by 


-A (t-di) 

f ri (t) = A r ^e , t >_ di 
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t > 0 


-x s (t) 

£ Sl Ct) = x Sl e 

fs 2 Ct) = X s ^e , t > 0 


where di can be considered the absolute minimum dead time of the unit if the 
last impulse is due to the spontaneous depolarization of the cell membrane 
( event 1) . However, the density function of the random variable r 2 is taken 
to be 


f (t) = 6 (t - d 2 ) > t >_ 0 
r 2 

(where 6( ) is the Dirac delta function) since r 2 denotes the dead time of 
the unit if the last spike is due to the random excitation hypothesis which 
assumes no inhibitory interaction among the cells of the unit. Consequently, 
the dead time in this case should be directly related to the refractory period 
of the nerve fiber, denoted here by d 2 . Since 

T n = r i + s i 

ti2 = r x + s 2 

t 2 i = r 2 + si 


t 22 = r 2 + s 2 

it follows that the density function of the variables in, t 12 , t 2 j, and t 22 
is given by 


X X 

Si Ti 


X - X 

11 Si r x 


"*r, (t-di) -*s C"t-d-i ) 

» - e 1 


, t >_ d : 


X X 
s 2 Ti 


f ' r 12^ t ' ) x - X 

s 2 Ti 


-^ ri (t-di) -X s (t-di) 
1 - e 2 


, t >_ di 


" A S! t t_d 2) 

f T (t) = X e e 1 , t > d 2 


21 


s l 


-X s (t-d 2 ) 

f (t) = X s e 2 , t > d 2 

loo o — 


22 
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Further, if dz di, the probability density of an interval of time, 
from equation (la) or (lb) , is explicitly given by 


f T (t) = (1 - a) 


f T (t) = 


-X s (t-d 2 ) -As (t-d 2 )' 

(1 - 622)^0,® 1 + 022*c e 2 

s 2 


L 

( A A 

Sl r l 

r-^i 

(t-di) ~X S (t-di)" 

- e 1 

P 11 A 

e 

\ si n 

- 

- 

A A . 

s 2 ri 

j (^“^1 ) ”^ S 2 ^ 

e - e 

(i - Bn) j — : 

A 

S2 

r l 



d 2 t dj 


+ (1 - a) 


-A s (t-d 2 ) -A s (t-d 2 ) 

(i - e 22 )* Sl e 1 + ^22^ S2 e 2 


, t 1 d x 


where 


J 

(2a) 


a = (1 - Bn )/ (2 - Bn - 822 ) 
The corresponding distribution function is 


F T (t) - (1 - o) 


-A_ (t-d 2 ) -A (t-d 2 ) 

1 - (1 - B 22 ) ® 1 “ B 22 e 2 


, d 2 <_t <_ dj 


(2b) 


F T (t) = all - Bn 


A A 
si rj 

A - A 


- x s, (t-di) - ^r (t-di) 


- (1 - Bn) 


s 2 


r i L 

si 

r l J 

s 2 Xr ! 

r -* s (t-di) 

e 2 

-X r (t-dj) 
e 1 

- A 

A 

x 

r l 

L s 2 

r l J 


+ (1 - a) 


-A (t-d 2 ) 

1 - (1 - &22) e ~ B22 e 


-A (t-d 2 )' 
s 2 


t > dj 


The average interval time length, from equation (Id), is expressed by 


E(x) = aE(Xj) + (1 - a)E (X 2 ) 


(2c) 
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where 


A + A 
r 1 s l 


E ( x l) = 6n I — — ^ + dj I + (1 - 3n) 


xi s x 


A + X 
r i s 2 

— X A 
r l s 2 


+ di 


and 


i(X 2 ) - (1 - 3 2 2) ^ — + + &22 — + 


From equation (le), the variance is found to be 

Var(x) = aVar(X 2 ) + (1 - a)Var(X 2 ) + a(l - a)[E(X!) - E(X 2 )] : 
where Var(Xj), Var(X 2 ) are now explicitly written as 


Var (X x ) = 3n 


and 


'A 2 + A 2 , 

r i s x 

A 2 A 2 
r l si 


+ (1 - 3n) 


'A 2 + A 2 

*1 s 2 | 

2 2 
A A 
ri s 2 


(2d) 


Var(X 2 ) = (1 - 3 2 2) ("4- j + $22 ( ~Y 

X s 1/ \ s 2, 


Similarly, the explicit form of the serial correlation function, obtained by 
substituting the above expressions for E(Xi), E(X 2 ), Var(Xi), and Var(X 2 ), 
into equation (If) , is then given by 


p k 


[E(Xi) - E(X 2 )l 2 a(l - a) (3n + 3 22 - l) k 
aVar(Xx) + (1 - a)Var(X 2 ) + a(l - a)[E(Xx) - E(X 2 )] 2 


(2e) 


Thus, under the null-type hypothesis, the functional form of the distribu- 
tion function as given by equation (2b), or equivalently, the probability den- 
sity function given by equation (2c) , is seen to be the weighted sum of, at 
most, three exponential terms and the explicit forms of the descriptive charac- 
teristics of a given interval of time expressed by equations (2c) , (2d) , and 
(2e) . Moreover, special cases of the distribution function, given by equa- 
tion (2b) , may be derived by making various assumptions about the transition 
probabilities 3n, 322* These special cases represent different types of 
interval time processes with respect to their statistical characteristics, and 
three such processes of special interest are discussed in the following: 


12 


A-3818 



1 . If 3 u = 1 - 322 s equation (2b) then represents the probability 
density function of a renewal process. A renewal process is a stationary 
process whose interval times are independently and identically distributed. 

This implies that the interval time process, originally denoted as the ordered 
sequence of interval times xx, x 2 , x 3 , ... is not dependent on order . Its 
serial correlation function, given by equation (2e) , is thus equal to zero for 
lags of all orders . 

2 . If the random excitation hypothesis of spike generation is not sig- 
nificant, then the variables r 2 , s 2 have no effect; thus, . 3n * 1, 322 = 0* 
Since these values of 3 n» 822 satisfy the relationship 3 n = 1 - 822* the 
process is renewal and the distribution function given by equation (2b) reduces 
to 

— X siVl -As, (t-di) -A r (t-dx) 

F x^ = 1 - X- — x ■ • - e 1 

si r x 

( 3 a) 

which is seen to be the distribution function of the simplest generalization 
of an integral -order Erlang process. When X = X = X, the distribution 
function then becomes Sl ri 

-X(t-d) 

F T (t) = 1 - e [1 + X(t - dx)], t > dj ( 3 b) 

which is seen to be the Gamma distribution function of order 2 (chi-square, 
Pearson type III). 

3 . Finally, if the spontaneous depolarization hypothesis of spike genera- 
tion is not significant, then the variables rx, sx have no effect; thus 

3 ix = 0 , and 822 * Again, since these values of Bxi» 822* satisfy the 
relationship Bx 1 = 1 - 322* the process is renewal and the distribution func- 
tion given by equation (2b) reduces to 


t >_ dx , 


si 


* A, 


-A (t-d 2 ) 

F T (t) - 1 -e 52 , t > d 2 ( 3 c) 

which is the negative exponential distribution function characteristic of a 
Poisson process. 

These results immediately suggest the possible functional forms of the 
distribution function that may be useful in empirically modeling the sponta- 
neous spike train activity of neuronal units exhibiting a dead time following 
each electrical impulse. Specifically, the examination of the null -type situa- 
tion suggests that the distribution function of the interval time process 
exhibited by such neuronal units could be possibly described by: 

1 . The negative exponential as given by equation ( 3 c) , 
or 


A-3818 


13 



2, The generalized Erlang as expressed by equation (3a) or its special 
case, the gamma of order 2 given by equation (3b), if the process is renewal, 
and 


3. A weighted sum of a mixture of two generalized Erlangs and a mixture 
of two negative exponential distributions as shown in equation ( 2 b) , if the 
process is renewal or nonrenewal. 

The plausibility of these results is somewhat substantiated from the 
standpoint that the negative exponential, the distribution function of a 
Poisson process, has been used to fit the observed distribution characteristics 
of neuronal spike trains by such authors as Rodieck, Kiang, and Gerstein 
(ref, 6 ) while a form of the gamma distribution was employed by Kuffler, 
Fitzhugh, and Barlow (ref. 7) . 

Therefore, the results of this paper suggest the following procedure for 
empirically modeling the observed distribution of interval times and thereby 
describing the statistical characteristics of the spontaneous electrical 
activity of nerve units exhibiting a dead time: 

1. Test the stationarity and renewal characteristics of the interval 
time process. (For a discussion of actual tests that can be used to examine 
these hypotheses see refs. 4 and 8 .) 

2. After determining the stationarity and renewal characteristics, 
empirically model the observed distribution of interval times in the following 
manner : 


If the process is found to be stationary but not renewal, then the 
appropriate form of the distribution function to use in empirically 
modeling or fitting the observed distribution is given by a weighted 
sum of exponentials of the form 


-X^t -X2t 

F T (t) = 1 - A x e - A 2 e 


t 0 < t < tj 


-X3t -Xjt -X2't 

F T (t) = 1 - A 3 e - (Aj - A 4 )e - (A 2 - A 5 )e , t >_ ti 


(4a) 


where Aj, A 2 , A 3 , A 4 , A 5 , Xj, X 2 > and X 3 are parameters subject to the 
restrictions that 


-Xit 0 - ^2 t 0 

A^e + A 2 e = 1 


Ai >_ 0 , i = 1 , 2 


and 


-X3tj “^1^1 -^2*1 

A 3 e + A t+e + A 5 e 


0 


X. > 0, i = 1, 2, 3 
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If, however, the process is found to be renewal, then in addition to the 
weighted sum of exponentials shown above, the functional forms of the distribu- 
tion that may be used to empirically model the observed distribution are given 
by the negative exponential. 


F X (10 


1 - 9 -W>, 


t > d 


the generalized Erlang, 


F x (t) = 1 


-Xi(t-d) 

Xi - x 2 L e 


-X 2 (t-d) 

C * 


t > d 


(4b) 


(4c) 


or its special case, the gamma of order 2, 

F T (t) = 1 - e“ X(t " d ^[l + A(t - d)], t >_ d (4d) 

It should be noted that in the case of a renewal process, the distribution 
function or, equivalently, the probability density function of the interval 
times completely specifies the statistical characteristics of the interval 
time process. 


CONCLUDING REMARKS 


The conceptualization of the spontaneous spike trains originating from 
neuronal units exhibiting a pronounced dead time as depicted in figure 2, 
albeit a naive representation of a complex process, enables one to study the 
possible forms of the marginal distribution function of the interspike times 
contained in such process. The resultant examination of the null-type case 
has use in establishing a reference point to determine any deviations from 
randomness that may be exhibited by an observed interspike (interval time) 
process. Moreover, the explicit forms of the distribution functions that have 
been determined in this paper may have use in empirically modeling the observed 
distribution of the intervals contained in the process. Specifically, if the 
process is found to be renewal, then the negative exponential (eq. (4b)), the 
gamma of order 2 (eq, (4d)), the generalized Erlang (eq. (4c)), or the weighted 
sum of exponentials (eq. (4d)) are the possible functional forms. If the 
process is nonrenewal but stationary, then the weighted sum of exponentials 
(eq. (4a)) is the most appropriate form of the distribution function. 

The determination of the most appropriate empiric model is important since 
the distribution function describes many of the statistical characteristics of 
the spontaneous electrical activity of neuronal units heretofore discussed. 
Moreover, the functional form of the distribution may be used as a basis for 
demonstrating how evoked activity differs from spontaneous activity. 

Ames Research Center 

National Aeronautics and Space Administration 

Moffett Field, Calif. 94035, November 20, 1970 
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APPENDIX 


ILLUSTRATIVE EXAMPLE 


The method of empirically modeling the distribution function of the 
interval times shown on pages 13-15 is applied to the observed interval time 
process resulting from the spontaneous electrical activity of an isolated ves- 
tibular neuronal unit of a frog. 1 The electrical impulses originating from 
this unit were measured over time and the resulting interval time process con- 
sisted of 997 spikes or 996 interval times where the initial spike defined the 
origin of the process. 


STATIONARY AND RENEWAL CHARACTERISTICS 


The hypotheses of stationarity and renewal were examined and it was 
determined by nominal 5 percent level tests that the interval time process 
could be characterized as being stationary and renewal. The tests used to 
examine these hypotheses are those suggested by Lewis (ref. 8) on pages 207- 
208 and 212-213. The stationarity hypothesis was essentially tested by exam- 
ining whether the mean rate of spike occurrence remained constant oyer time 
and is based upon the necessary condition that no trends over time exists in 
the mean rate of spike occurrence if the process is stationary. Similarly, 
the test used to examine the renewal hypothesis is based upon the necessary 
condition of a renewal process that the serial correlation function is zero 
for all lags. 


Empirically Modeling the Cumulative Distribution 
of Interval Times 


The empiric distribution is calculated by first ranking all the interval 
times in order of magnitude to obtain the ranked series tj, t 2 , .... 

The observed cumulative distribution function may then be computed by 

F (t) = i/N , 1 1 i 1 N 

where N is the total number of intervals contained in the observed process. 
The resultant empiric distribution, shown in 2 ms increments, and the descrip- 
tive statistics of the observed interspike times are shown in the following 
table. 


^he -data were collected by R. S. Carpenter, Ames Research Center, 1969, 
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TABLE l.~ OBSERVED DISTRIBUTION OF THE INTERSPIKE TIMES 


BASED ON A SAMPLE OF 996 


Time, 

ms 

Distribution 

Time, 

ms 

Distribution 

Time, 

ms' 

Distribution 

10 

0.0110 


44 

0.7701 

78 

0.9649 

12 

.0291 


46 

.7972 

80 

.9679 

14 

.0733 


48 

.8213 

82 

.9689 

16 

.1044 


50 

.8353 

84 

.9729 

18 

.1556 


52 

.8524 

86 

.9789 

20 

,2209 


54 

.8655 

88 

.9799 

22 

.2821 


56 

.8785 

90 

.9829 

24 

.3444 


58 

.8966 

92 

.9859 

26 

.4167 


60 

.9046 

94 

.9880 

28 

.4789 


62 

.9127 

96 

.9910 

30 

.5281 


64 

.9197 

98 

.9920 

32 

.5643 


66 

.9297 

100 

.9940 

34 

.6104 


68 

.9378 

102 

.9950 

36 

.6486 


70 

.9468 

104 

.9950 

38 

.6787 


72 

.9518 

106 

.9950 

40 

.7189 


74 

.9568 

108 

.9980 

42 

.7470 


76 

.9598 



Minimum interval 

time = 8. 

1 ms 



Maximum interval 

time = 129.0 ms 



Average interval 

length = 34.057 ms; variance = 

341.957 ms 2 


The procedure outlined on pages 13-15 of this paper shows that if the 
process is renewal, then the possible forms of the distribution are given by 
those of the negative exponential (eq. (4b)), the generalized Erlang 
(eq. (4c)), its special case the gamma of order 2 (eq. (4d)), or the weighted 
sum of exponentials (eq. (4a)). The method employed here to establish an 
empiric model of the distribution function was to use sequentially the above 
forms of the distribution until an adequate fit of the observed distribution 
was obtained. A nominal 5 percent Kolmolgorov-Smirnoff goodness of fit test 
(ref. 9) was used to judge the adequacy of the fit and this test is based upon 
the statistic 


KS = max 
l<i<_N 


(i/N) 


Mti) 


where F T (t) is the hypothesized distribution. The 5-percent two-sided crit- 
ical value of this statistic is given by 1.358/ /hf which in our case is equal 
to 0,043 since N = 996. 


Hence, the negative exponential distribution function given from equa- 
tion (4b) by 


F x (t) 


-X(t-d) 
c > 


t > d 
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was initially used to fit the observed distribution. The method of moments 
was used to estimate the rate parameter A and the minimum dead time d. 
This method involves equating the theoretical moments to the corresponding 
observed moments; and for the present case, the resulting equations are 


E(x) = 1/A + d = 34.057 


and 

Var(x) = (1/A) 2 = 341.957 


The theoretical form of E(x), and Var(x) can be obtained from equations (2c) 
and (2b) by setting Bn = 0, 522 = 1 while the observed moments are shown in 
table 1. The estimates of the parameters are then seen to be A = 0.05408 
spikes/ms and d = 15.56. The observed value of the KS statistics was found 
to be 0.098 which is seen to be greater than the 5-percent critical value of 
0.043, thus indicating a significant lack of fit. Hence, the generalized 
Erlang distribution function, given from equation (4c) by 


F T (t) = 1 


X ! X 2 f -Ai(t-d) - A 2(t-d)~ 

Al * A 2 ® "® 


t > d 


was then used in the attempt to find an adequate empiric model. Again, the 
method of moments was employed to obtain estimates of the parameters Aj, A 2 , 
d, where the equations involving the first two moments are expressed by 

A 1 + X 2 

E(t) = — r — r + d = 34.057 

A 1 A 2 

Al 2 + A 2 2 

Var ( t) = = 341.957 

Ai 2 A 2 2 

or 


Ai , A 2 


(34.057 - d) ± / 2(341 . 957) - (34.057 - d) 2 
(34.057 - d) - 341.957 


The first and second moments, E(x) and Var(x), may be obtained from equa- 
tions (2c) and (2d) by substituting the values 1 and 0 for Bn and B 22 . For 
a real solution to exist, d must satisfy the inequality d £ 34.057 - /683.914 
or d £ 7.905. Also, since d min(ti . . . tggg), where the minimum time 
from table 1 is seen to be 8.12, it follows that 7.905 <_ d <_ 8.125. These 
bounds define well the possible values of d, and the midpoint of the interval 
was taken to be the estimate of d. Thus d = 8.01, and when this value of d 
is substituted into the above relationships, it is seen that Ai = 0.070459 
and A 2 = 0.084357. The observed value of the KS statistic was computed to 
be 0.028, and since this value is less than the 5-percent critical value, it 
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was concluded that the generalized Erlang function given explicitly by 

F T (t) = 1 + 0. 42767 [ll.85438e‘°* 084357 (t " 8 ' 0i:) - l4.19265e"°” 070459( ' t ' 8 ' 01 - ) ] , 

t >_ 8.01 

was an adequate empiric model of the observed distribution. For purposes of 
visual comparisons, the fit given by the negative exponential and the 
generalized Erlang distribution functions are shown in figure 4. 



Tim*, m**c 

Figur® 4»- Interval tis® distribution. 
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